(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 

International Bureau 

(43) International Publication Date 
30 May 2002 (30.05.2002) 




PCT 



II II ll ll 



(10) International Publication Number 

WO 02/43003 Al 



(51) International Patent Classification 7 : G06T 3/00 

(21) International Application Number: PCT/SG00/00185 

(22) International Filing Date: 

24 November 2000 (24.1 1.2000) 



(25) Filing Language: 

(26) Publication Language: 



English 
English 



(71) Applicant (for all designated States except US): KENT 
RIDGE DIGITAL LABS [SG/SG]; 21 Heng Mui Keng 
Terrace, Singapore 119613 (SG). 

(72) Inventors; and 

(75) Inventors/Applicants (for US only): NOWINSKI, 

Wieslaw, L. [PL/SG]; 111 Clementi Road, #10-06, 

Nus Kent Vale, Blk C, Singapore 129792 (SG). 



THIRUNAVUUKARASUU, A. [SG/SG]; 
Ketumbit, Singapore 808893 (SG). 



40 Jalan 



(74) Agent: GREENE-KELLY, James, Patrick; Lloyd Wise, 
Tanjong Pagar, P.O. Box 636, Singapore 910816 (SG). 

(81) Designated States (national): AE, AG, AL, AM, AT, AU, 

AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CR, CU, CZ, 
DE, DK, DM, DZ, EE, ES, FT, GB, GD, GE, GH, GM, HR, 
HU, ID, IL, IN, IS, JP, KE, KG, KP, KR, KZ, LC, LK, LR, 
LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, MX, MZ, 
NO, NZ, PL, PT, RO, RU, SD, SE, SG, SI, SK, SL, TJ, TM, 
TR, TT, TZ, UA, UG, US, UZ, VN, YU, ZA, ZW. 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European 
patent (AT, BE, CH, CY, DE, DK, ES, FT, FR, GB, GR, IE, 
IT, LU, MC, NL, PT, SE, TR), OAPI patent (BF, BJ, CF, 
CG, CI, CM, GA, GN, GW, ML, MR, NE, SN, TD, TG). 

[ Continued on next page ] 



(54) Title: METHODS AND APPARATUS FOR PROCESSING MEDICAL IMAGES 




Read the image data in Dicom format 



Register the brain atlas with the data 



Segment and label the data with the brain 
atlas 



(57) Abstract: A system for analysing a brain image compares 
the image with a brain atlas, labels the image accordingly, and 
annotating the regions of interest and/or other structures. This at- 
las-enhanced data is written to a file (or more than one file) in the 
Dicom format or any web-enabled format such as SGML or XML 
format. The image used may be produced by any medical imag- 
ing modality. A fast algorithm is proposed for a landmark-based 
piecewise linear mapping of one volumetric image into another 
volumetric image. Furthermore, a new set of brain landmarks are 
proposed, and algorithms for the automatic identification of these 
landmarks are formulated for three orientations, axial, coronal, 
and sagittal. 



o 



Define the regions of interest 



Annotate the regions of interest 




Save the labeled and annotated image 
data in Dicom and/or web-enabled 
(e.g. XML) formats 



wo 02/43003 Al I lllll llllllll II llllll Hill llll I II III lllll Hill Hill Hill III! lllllll llll III! llll 



Published: For two-letter codes and other abbreviations, refer to the "Guid- 

— with international search report ance Notes on Codes and Abbreviations " appearing at the begin- 

ning of each regular issue of the PCT Gazette. 



WO 02/43003 



PCT/SG00/00185 



1 

Methods and Apparatus for processing medical images 
Field of invention 

The present invention relates to methods and apparatus for manipulating medical 
images of brains. In particular it relates to systems for using a brain atlas to annotate a 
5 medical image, and saving the resultant image for subsequent utilisation. 

Background of the invention 

Modem medical imaging technologies offer unprecedented views into human body. 
Our ability to generate images is much greater than the ability to understand and 
interpret them. Deformable body models along with warping techniques provide 
1 0 means for analysis of medical images and deformable brain atlases, in particular, are 
useful for analysis of brain scans. The purpose of the present invention is to facilitate 
the interpretation of brain scans by neuroradiologists and to provide means to transfer 
this knowledge to other medical professionals such as neurologists and 
neurosurgeons. 

15 The present inventor has developed an electronic brain atlas database [3]. There is a 
strong commercial interest in this database for functional neurosurgery and the atlas 
has been integrated with several commercial systems. 

Apart from this electronic brain atlas, there are numerous brain atlases available in 
printed form such as [4], and a number of electronic atlases have also been 
20 constructed. The major use of the brain atlases is for neuroeducation [2]. Some other 
applications include functional neurosurgery and brain mapping. However, to our best 
knowledge, there is no commercial application of brain atlas in neuroradiology yet. 

A key operation in atlas-assisted analysis is registration of the atlas with the patient 
data. The atlas can be warped against the data or, alternatively, the data is warped 
25 against the atlas. One of registration approaches is the Talairach proportional grid 
system transformation that is a piecewise linear operation applied to the volumetric 
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image subdivided by the Talairach landmarks into 12 volumetric sub-images [4]. One 
known technique performs the Talairach transformation in realtime based on texture 
mapping, but it requires a hardware accelerator for texture mapping to be performed 
efficiently. 

5 In addition, the placement of the landmarks is manual and needs domain knowledge. 
Several non-linear warping approaches have also been proposed [1], but they are time 
consuming, highly dependent on starting points and at present far from clinical 
applications yet. 

Summary of the invention 

10 In general terms, the present invention proposes that a system for analysing a brain 
image comprises receiving a brain image, comparing the image with a brain atlas, 
labelling the image accordingly, and annotating the regions of interest and/or other 
structures. The image used in the invention may be an image produced by any 
medical imaging modality. 

15 

We further propose a fast algorithm for a landmark-based piecewise linear mapping of 
one volumetric image into another volumetric image. 

Furthermore, because of the importance of the Talairach transformation for clinical 
applications, we propose a new set of the landmarks, and algorithms for the automatic 

20 identification of these landmarks are formulated for three orientations, axial, coronal, 
and sagittal. It is assumed that the reference planes of the data are given by the user, 
such as intercommissural plane or interhemispheric (longitudinal) fissure. If 
necessary, automatic identification of the reference planes may be attempted by using 
some public domain algorithms, e.g. [5]. Some presented algorithms may benefit from 

25 extracting the brain from the head data prior to landmark identification, and there are 
several public domain algorithms to do it - however this step is merely preferable in 
the present invention. 
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Generally, the landmarks we choose here to use are defined by peaks and valleys 
(troughs) of density profiles or projections. Clearly, the significance of peaks and 
valleys are reversed if the image is replaced by a reversed intensity image (e.g. a T2- 
weighted image rather than a Tl -weighted image). 

5 A system combining various aspects of the invention may be fast, almost fully 
automatic, and need not require any hardware accelerator. This is because the 
registration technique makes use of anatomical knowledge to narrow the search 
within the brain space, and permits the use of simple analysis operations. 

Furthermore, radiology is becoming digital and integration of image data (from 
10 PACS) with textual data is becoming more available. Telemedicine, especially web- 
enabled, is also booming. The present invention is well aligned with these trends. 

Preferably, the brain data is read from a file in the Dicom format, and atlas-enhanced 
data is written to a file (or to more than one file) in the Dicom or any web-enabled 
format such as SGML or XML format. Dicom is the standard format for digital 
15 imaging and communications in medicine. XML is an emerging standard in web 
applications. 

Although the invention has been described above in terms of a method, all aspects 
may equivalently be expressed as a computer device having a processor arranged to 
carry out a method according to the invention. 

20 

Brief description of the drawings 

Embodiments of the invention will now be described by way of example only. 

FIG. 1 is the flowchart showing the steps in an embodiment of a method according to 
the invention. 
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FIG. 2 illustrates the concept and steps of mapping one rectangular image into another 
rectangular image. 

FIG. 3 extends the concept from FIG. 2 into third dimension. 

FIG. 4 defines the Talairach-Nowinski landmarks used for registration. 

5 FIG. 5 is a histogram of brain image with a four-class model, white matter (WM) 5 
grey matter (GM), cerebro-spinal fluid (CSF) and background (B). 

FIG. 6a is a graph of the convex ideal and real peaks corresponding to a structure of 
interest. 

FIG. 6b is a graph of the concave ideal and real peaks corresponding to a structure of 
1 0 interest. 

FIG. 7a is a diagrammatic representation of the axial brain image passing through the 
AC and PC landmarks along with the structures of interest. 

FIG. 7b is a graph representing a vertical (antero-posterior) projection taken from the 
image in FIG. 7a with the marked valleys of interest. The graph is valid for Tl- 
1 5 weighted and proton density magnetic resonance imaging (MRI) images. 

FIG. 7c is a graph representing a plot of intensities along the AC-PC line as drawn in 
FIG. 7a. 

FIG. 7d is a graph representing a horizontal projection taken from the image in FIG. 
7a with the marked valleys of interest. The graph is valid for Tl -weighted and proton 
20 density MRI images. 

FIG. 8 contains the graphs representing orthogonal (parallel) projections taken from 
the axial image lying in the AC-PC plane. The graph with the deepest central valley 
(in the center) corresponds to the projection along the AC-PC direction. 
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FIG. 9 is a graph representing a vertical projection taken from the image in FIG. 7a 
with the marked peaks of interest. The graph is valid for T2-weighted MRI images. 

FIG. 10a is a diagrammatic representation of the coronal brain image passing through 
the AC along with the structures of interest. 

5 FIG. 10b is a graph representing a plot of intensities along the AC (vertical) line as 
drawn in FIG. 10a. 

FIG. 10c is graph representing a partial vertical projection of the image in FIG. 10a 
taken from the AC horizontal line ventrally down. The highest peak corresponds to 
the I landmark. 

1 0 FIG. 1 la is a diagrammatic representation of the coronal brain image passing through 
the PC along with the structures of interest. 

FIG. lib is a graph representing a plot of intensities along the PC line as drawn in 
FIG. 11a. 

FIG. 12 is a diagrammatic representation of the midsagittal brain image along with the 
1 5 structures of interest. 

FIG. 13 illustrates three different regions of interest, ellipsis, rectangle and polyline. 

FIG. 14 is a chart illustrating the process of generating and transferring of atlas- 
enhanced images. The images are prepared by the neuroradiologist and are transferred 
to other medical professionals through web-enabled applications (in XML format) and 
20 through PACS-dependent physician's workstations (in Dicom format). 

FIG. 15 illustrates saving of the atlas-enhanced image in Dicom format. 

Detailed Description 



1 . Introduction 
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FIG. 1 illustrates in conceptual terms a method according to the present invention. 

The patient specific image data are read in Dicom format (step 1), which is a standard 
format in diagnostic imaging and Dicom readers are commonly available. Then in 
step 2, the brain atlas is registered with the data (a fast, automatic method to do it is 
5 given below), so the neuroradiologist can segment and label the data by means of the 
atlas (step 3). In particular, the region(s) of interest can be defined on the images (step 
4) and annotated (step 5), and segmentation and labeling can be done within these 
regions of interests. In addition, the image structures can optionally be measured (step 
6). In step 7, the atlas-enhanced data can be stored for further processing by other 
1 0 medical professionals, such as neurologists and neurosurgeons. In particular, the atlas- 
enhanced data can be stored in Dicom format and/or in any web-enabled format such 
as XML. These steps are described in much detail below. 

2. Registration 

First, a general algorithm for mapping one volumetric image into another one is 
1 5 formulated. Then, the detailed steps for performing data-to-atlas mapping and atlas- 
to-data mapping are specified by using this algorithm. Next, the use of this algorithm 
to perform the Talairach proportional grid system transformation is discussed. In 
particular, the algorithms for the automatic identification of the landmarks required 
for the Talairach transformation are formulated for each orthogonal orientation: axial, 
20 coronal, and sagittal. 

2.1. Volumetric image to volumetric image mapping 

The method of mapping a volumetric image composed of rectangular images into 
another volumetric image composed of rectangular images is proposed in the present 
invention. First, the mapping of the single image into another image is presented and 
25 illustrated in FIG. 2. Then, the mapping in the third dimension is given and illustrated 
in FIG. 3. 
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The mapping of the single rectangular image into another rectangular image with, in 
general, a different dimension is shown in FIG. 2. Image A containing Object A is 
mapped into Image B with object B. First some point landmarks are defined in Image 
A (Step 1). These may be some anatomical landmarks or other characteristic points. 
5 In particular, they may be the Talairach landmarks. In FIG. 2, the landmarks are the 
comers of Object A. Then, the corresponding landmarks are defined in Image B. Both 
sets of landmarks carry the information about the common features in the images 
under registration. Next, each image is subdivided into subimages (rectangular tiles) 
by drawing the lines horizontal and vertical to image edges and passing through the 
10 landmarks (Step 2). Next, the correspondence between each pair of the tiles is 
established by, for example, following the same order of numbering the tiles in both 
images (Step 3). Finally, for each corresponding pair of the tiles, each tile from Image 
A is mapped proportionally in two dimensions into the corresponding tile in Image B. 
In this way, the complete Image A is transformed into Image B. 

15 In the third dimension, mapping of one volumetric image into another volumetric 
image involves a suitable placement of the images, without warping them. The 
mapping of Volumetric image A into Volumetric image B is shown in FIG. 3. The 
corresponding edges in third dimensions are identified in both volumetric images. 
Edge A is subdivided into edge segments and Edge B is subdivided into 

20 corresponding edge segments too. For each edge segment of Edge A the images from 
the Volumetric image A lying within this edge segment are placed proportionally 
within the corresponding edge segment of segment B. In this way, the placement of 
the images along the third dimension is done piecewise linearly. 

For the known sets of the corresponding landmarks, the mapping algorithm can be 
25 performed fully automatically without user intervention. 

2.2. Atlas-data registration 

There are two ways of putting the images and the atlas in registration, atlas-to-data 
mapping and data-to-atlas mapping. Either of the techniques according to the present 
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invention is very fast compared to the known techniques, and can be performed in a 
fraction of a second, rather than, as in known techniques, in minutes, hours or even 
days. 

2.2.1. Atlas-to-data mapping 

5 The following steps are done to warp the atlas against the data (Steps 1-8) and to 
visualize the fused volumetric image (Step 9): 

1. Identify the landmarks on the data. 

2. Identify the landmarks on the atlas. 

3. Tile the atlas along the atlas landmarks; in this way the set of rectangular atlas tiles 
10 is created. 

4. Select an edge on the tile for tile correspondence; for instance, the line segment 
connecting the top-left corner with the bottom-left comer can be selected. 

5. For each atlas tile, scale it proportionally to fit to the corresponding data tile. 

6. For each scaled atlas tile, place it on the corresponding data tile edge. 

15 7. Identify the landmarks along the edges in the third dimension for both atlas and 
data 

8. Place the warped atlas images piecewise linearly within the (volumetric) data. 

9. Blend the registered images interactively; if they do not overlap, take the closest 
atlas image. 

20 2.2.2. Data-to-atlas mapping 

The following steps are done to warp the data against the atlas (Steps 1-8) and to 
visualize the fused volumetric image (Step 9): 
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1 . Identify the landmarks on the atlas, 

2. Identify the landmarks on the data. 

3. Tile the data along the data landmarks; in this way the set of rectangular data tiles is 
created. 

5 4. Select an edge on the tile for tile correspondence; for instance, the line segment 
connecting the top-left corner with the bottom-left comer can be selected. 

5. For each data tile, scale it proportionally to fit to the corresponding atlas tile. 

6. For each scaled data tile, place it on the corresponding atlas tile edge. 

7. Identify the landmarks along the edges in the third dimension for both data and 
10 atlas. 

8. Place the warped data images piecewise linearly within the (volumetric) atlas. 

9. Blend the registered images interactively; if they do not overlap, take the closest 
data image. 

2.3. Automatic identification of the Talairach landmarks 

1 5 The mapping method is particularly important when the landmarks are the Talairach 
landmarks. We define a new set of equivalent landmarks, so called Talairach- 
Nowinski landmarks, which are suitable for the mapping algorithm illustrated in FIG. 
2 and FIG. 3. For these landmarks, we formulate an automated method for their 
identification provided that the images are parallel or perpendicular to the reference 

20 planes, it means the midsagittal plane and/or the intercommissural (AC-PC) plane. 
Otherwise, any public domain algorithm for the identification of the midsagittal plane 
can be used and the data have to be reformatted accordingly. 

The orientations of the images (and consequently the location of the landmarks) 
comply with the radiological convention: 
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- on axial images, the nose points to the top and the left hemisphere is on the right 
hand side 

- on coronal images, the left hemisphere is on the right hand side 

- on sagittal images, the nose points to the left. 
5 Talairach landmarks 

The Talairach landmarks (T landmarks) are defined as follows: 

AC - the anterior commissure; as the anterior commissure is a three-dimensional 
structure, the AC point landmark is defined as the intersection of the horizontal line 
passing through the superior edge of the anterior commissure and the vertical line 
1 0 passing through the posterior edge of the anterior commissure 

PC - the posterior commissure; as the posterior commissure is a three-dimensional 
structure, the PC point landmark is defined as the intersection of the horizontal line 
passing through the inferior edge of the posterior commissure and the vertical line 
passing through the anterior edge of the posterior commissure 

15 L - the most lateral point of the parietotemporal cortex for the left hemisphere 

R - the most lateral point of the parietotemporal cortex for the right hemisphere 

A - the most anterior point of the frontal cortex 

P — the most posterior point of the occipital cortex 

S — the highest, most superior (most dorsal) point of the parietal cortex 

20 I - the lowest, most inferior (most ventral) point of the temporal cortex. 
New set of landmarks 
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In order to increase efficiency, we introduce in the present invention a new, 
equivalent set of landmarks called Talairach-Nowinski landmarks (T-N landmarks). 
These landmarks are defined in a more constructive way than the original Talairach 
landmarks. They are easier to identify, facilitate performing the mapping as described 
5 in FIG. 2 and FIG. 3, and can still be used to perform the Talairach transformation. 
The T-N landmarks are shown in FIG. 4 and are defined as follows. 

AC — the anterior commissure defined as the central point (the gravity center) of the 
intersection of the anterior commissure with the midsagittal (interhemispheric) plane 

PC - the posterior commissure defined as the central point (the gravity center) of 
1 0 the intersection of the posterior commissure with the midsagittal plane 

L - the point of intersection of three planes: the AC-PC (intercommissural) axial 
plane, the coronal plane passing through the PC, and the sagittal plane passing 
through the most lateral point of the parietotemporal cortex for the left hemisphere 

R- the point of intersection of three planes: the AC-PC axial plane, the coronal 
1 5 plane passing through the PC, and the sagittal plane passing through the most lateral 
point of the parietotemporal cortex for the right hemisphere 

A- the point of intersection of three planes: the AC-PC axial plane, the 
midsagittal plane, and the coronal plane passing through the most anterior point of the 
frontal cortex 

20 P - the point of intersection of three planes: the AC-PC axial plane; the 
midsagittal plane, and the coronal plane passing through the most posterior point of 
the occipital cortex 

S — the point of intersection of three planes: the coronal plane passing through the 
PC, the midsagittal plane, and the axial plane passing through the highest, most 
25 superior (most dorsal) point of the parietal cortex 
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I - the point of intersection of three planes: the coronal plane passing through the 
AC; the midsagittal plane, and the axial plane passing through the lowest, most 
inferior (most ventral) point of the temporal cortex. 

The algorithm for the automatic identification of the T-N landmarks exploit 
5 anatomical knowledge and image knowledge. One source of image knowledge is 
histogram. We describe below two common operations, histogramming and peak 
identification, followed by the description of the algorithms. 

Histogramming 

The algorithms formulated below require information about the distribution of brain 
10 structures. A standard operation known as histogramming is used for this purpose. 
The brain is modeled as a mixture of four classes, white matter (WM), grey matter 
(GM), cerebro-spinal fluid (CSF) and background (B). Each class has its 
characteristic bell-shape curve on the histogram. The bells are separated by the 
valleys. The lowest points in two valleys surrounding the bell of a given class define 
1 5 the range of intensities corresponding to this class, see FIG. 5. 

Peak identification 

Another common operation used in the algorithms below is the identification of a 
peak corresponding to a structure of interest. The modeling of the peak representing a 
brain structure of a given class is illustrated in FIG. 6a. The ideal model of a class 
20 assumes homogeneity of intensity so any profile, calculated as the intersection of the 
structure by a line segment, has a bar shape. The real profile differs from the 
theoretical one because of noise, partial volume effect, not ideal positioning of the 
image with respect to the reference planes. Therefore, the algorithms take additional 
checking against real phenomena. The real and ideal peaks are shown in FIG. 6a. 

25 The peak can be convex, see FIG. 6a, or concave, see FIG. 6b. For instance, a WM 
structure on a Tl -weighted magnetic resonance imaging (MRI) image or PD (proton 
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density) MRI image has a convex peak, while a WM structure on a T2-weighted MRI 
image has a concave peak. 

In order to identify a peak, either convex or concave, any standard edge detection 
method can be used, in particular the calculation of zero crossing of the second 
5 derivative. This calculation is performed for the increasing (start point) and 
decreasing (end point) slope of the peak, as illustrated in FIG. 6a. The location of the 
modeled structure is taken as the arithmetical average (the mean value) of the start 
and end points. 

Below, the algorithms for the automatic identification of the T-N landmarks are 
described in detail for axial, coronal, and sagittal orientations. 

23.1. Axial orientation 

2.3.1.1. Non-rotated axial images 

First, the case is considered when the images are not rotated, i.e., the AC-PC line is 
vertical. The AC-PC image is given (selected by the user), and its anatomy in the 
region containing the AC and PC in shown in FIG. 7a. From the vertical (anterior- 
posterior) projection of the image, the lateral position of the AC-PC line is identified 
at the location of the lowest point in the central valley (resulting from the highest 
amount of cerebro-spinal fluid), FIG. 7b. When traversing the AC-PC line antero- 
posteriory, the ideal intensity plot should be as in FIG. 7c. Knowing the peaks and 
their order, it is possible to identify the AC and PC. 

For the selected AC-PC image, the below algorithm identifies the T-N landmarks 
automatically in the following steps. 

1. Optionally, extract the brain from the AC-CP image. Use for that any standard 
operations, such as region growing combined with morphological operations. This 
step is not manadatory, but it facilitates the subsequent steps and can improve the 
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accuracy of landmark identification. The extracted brain is treated as the new AC-PC 
image, and the subsequent operations are applied to this image. 

2. Calculate the histogram of the AC-PC image and identify the intensity ranges for 
the cerebro-spinal fluid (CSF), grey matter (GM), white matter (WM) and background 

5 (B) as shown in FIG. 5. 

3. Calculate the vertical (antero-posterior) orthogonal projection of the AC-PC image. 
The shape of this projection is as in FIG. 7b. 

4. Identify the valleys on this projection. The lowermost point of the central valley 
defines the lateral position of the AC-PC line. The lowermost point of the left external 

10 valley defines the sagittal extent of the right landmark (R). The lowermost point of the 
right external valley defines the sagittal extent of the left landmark (L). In case when 
the brain is extracted from the AC-PC image, the external peaks/valleys do not exist. 
Then, the left and right slopes of the projection define the sagital extents of the brain. 

5. Calculate the intensity profile along the AC-PC line. In the ideal case, this profile 
15 should look like in FIG. 7c. The real profile differs from the ideal one because of 

noise, partial volume effect, not ideal positioning of the image, and possible brain 
scoliosis. 

6. Traverse this profile. Any direction of traversing can be used, such as starting 
anteriorly and move towards the AC, or take the midpoint along the AC-PC line 

20 segment and move towards the AC. Identify the first WM peak from top (anterior) 
along the AC-PC. Take this peak as the AC peak. 

7. For the identified AC peak, find its start and end points. Any method can be used 
for this purpose. In particular, the zero crossing of the second derivative can be used, 
see FIG. 6. 

25 8. As the AC landmark, take the mean value of the start and end points of the 
identified AC peak. 
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9. Move posteriorly along the AC-PC line and identify another WM peak, see FIG. 
7c. Take this peak as the PC peak. 

10. For the identified PC peak, find its start and end points. Any method can be used 
for this purpose. In particular, the zero crossing of the second derivative can be used, 

5 see FIG. 6. 

11. As the PC landmark, take the mean value of the start and end points of the 
identified PC peak. 

12. For the given sagittal positions of the L and R landmarks, calculate their three- 
dimensional positions based on their definitions from FIG. 4. 

10 13. Calculate the horizontal (right-left hemisphere or left-right image) orthogonal 
projection of the AC-PC image. The shape of this projection is as in FIG. 7d. 

14. For the calculated horizontal projection, identify the lowermost points of the 
extreme valleys and take them as the coronal extents of the anterior (A) and posterior 
(P) landmarks, see FIG. 7d. In case when the brain is extracted from the AC-PC 

1 5 image, the external peaks/valleys do not exist. Then, the left and right slopes of the 
projection define the antero-posterior extents of the brain. 

15. For the given coronal extents of the A and P landmarks, calculate their three- 
dimensional positions based on their definitions from FIG. 4. 

16. Place at the PC that atlas coronal plate, which passes through the PC, and scale it 
20 linearly to fit to the R-L distance. The dorsal extreme of the atlas plate defines the 

axial extent of the superior (S) landmark. Place at the AC that atlas coronal plate, 
which passes through the AC, and scale it linearly to fit to the R-L distance. The 
ventral extreme of the atlas plate defines the axial extent of the inferior (I) landmark. 

17. For the given axial extents of the S and I landmarks, calculate their three- 
25 dimensional positions based on their definitions from FIG. 4. 
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For the real data, the above algorithm has to be extended with additional checking and 
fine tuning capabilities. 

- Step 4: position of the AC-PC line can be enhanced by going to the third ventricle 
(V3), calculating the horizontal profile, identifying the CSF peak; calculating its 

5 center, and placing there the AC-PC line. This enhancement may be important in 
brain scoliosis 

- Step 8: when calculating the AC, while traversing from the third ventricle towards 
the AC, if the end point of the AC peak is more than 3 mm apart from the start point, 
take as the AC the start point plus 1 .5 mm (the average diameter of the AC is 3 mm) 

10 - Step 9: position of the PC can be restricted be imposing a search limit ranging, for 
instance, (17 mm, 35 mm) starting from the AC 

- Step 1 1 : when calculating the PC, while traversing from the third ventricle towards 
the PC, if the end point of the PC is more than 2 mm apart from the start point, take as 
the PC the start point plus 1 mm (the average diameter of the PC is 2 mm) 

15 - Step 14: if there are two extreme valleys for the P landmark, take the second valley 
(as the first valley is between the scalp and dura matter) 

In addition, some steps may be optimized. For instance, there is not need to calculate 
the complete horizontal projection (Step 13). It can only be limited to a strip along the 
AC-PC line (for instance 10 pixels wide on each side of the AC-PC line). This 
20 operation additionally amplifies the peaks/valleys of interest, (in FIG. 7d). Similarly, 
the central part of the projection can be skipped. For instance, the part between the 
AC and PC may be omitted. 

In order to enhance the accuracy of identification of the R, L, A, and P landmarks in 
three dimensions, the relevant steps can be applied to the images lying outside the 
25 AC-PC image. In particular, the two-dimensional antero-posterior projection of the 
whole brain volume image can be calculated, and the sagittal extents of the L and R 
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landmarks and the axial extents of the S and I landmarks can be obtained from this 
projection. Similarly, by calculating the two-dimensional left-right projection of the 
whole brain volumetric image, the coronal extents of the A and P landmarks are 
obtained from this projection. 

5 2.3.1.2. Rotated axial images 

When the AC-PC image is rotated with respect to the AC-PC line, the rotation angle 
has to be defined and the data images have to be rotated, such that the AC-PC line is 
vertical (and then the algorithm formulated in section 2.3.1.1 for the non-rotated case 
can be directly applied). The rotation angle can be obtained by analyzing the 
1 0 orthogonal projections of the AC-PC image and by selecting the one with the deepest 
central valley (for Tl -weighted images), as it contains the most CSF. The rotation 
angle is calculated automatically in the following steps. 

1. Calculate the orthogonal projections of the AC-PC image by taking the projections 
with a given angle step (for instance every 5 degrees). 

15 2. Select the projections with bi-modal peaks (one central valley). 

3. From these projections select one with the deepest central valley, see FIG. 8. 

4. Generate more projections of the AC-PC image around the projection selected in 
step 3 with a finer angle step in the range of the given angle step. For instance, in the 
range of +/- 5 degrees around the projection selected in Step 3, the new image 

20 projections are generated with 1 degree finer angle step. 

5. Find the projection with the deepest valley. The angle corresponding to this 
projection with the vertical line gives the rotation angle. 

2.3.1.3. Imaging modality dependence 
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The presented algorithm, at least in the above formulation, is imaging modality- 
dependent. The shapes of the projections and profiles, as well as the order of the 
structure classes in the histogram depend on the modality used. However, by 
understanding its principle, it is straightforward to adapt it to any modality. For 
5 instance, the steps presented above work correctly for the images which intensities of 
CSF, GM, WM structures are increasing, like for Tl -weighted and PD MRI images 
(and this will be probably the most common case). In case of T2-weighted images, the 
order is opposite, it means CSF is the most intensive. FIG. 9 shows the vertical 
projection of the T2 -weighted image corresponding to (lying in the same position as) 
10 the image in FIG. 7a. The principle of the algorithm remains the same. However, the 
central and external valleys (representing CSF in Tl -weighted images) should be 
replaced by the central and external peaks (representing CSF in T2-weighted images), 
compare FIG. 7b and FIG. 9. Similarly, the convex peaks in FIG. 7c should be 
replaced by the concave peaks (as discussed in FIG. 6). 

15 2.3.2. Coronal orientation 

2.3.2.1. Non-rotated coronal images 

The user identifies one coronal image passing through the AC and another one 
passing through the PC. The anatomy of the AC image is shown in FIG. 10a, and the 
corresponding plot along the AC vertical line is drawn in FIG. 10b. The steps are as 
20 follows. 

1 . Optionally, extract the brain from the data. Use for that any standard operations, 
such as region growing combined with morphological operations. This step is not 
manadatory, but it facilitates the subsequent steps and may improve the accuracy of 
landmark identification. The extracted brain is treated as the new AC image, and the 
25 subsequent operations are applied to this image. 
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2. Calculate the histogram of this image and identify the intensity values for the 
cerebro-spinal fluid (CSF), grey matter (GM), white matter (WM) and background 
(B) as shown in FIG. 5. 

3. Calculate the complete vertical (dorso-ventral) orthogonal projection of the AC 
5 image. The shape of this projection is similar to that in FIG. 7b. If the calculated 

projection of the AC image substantially differs from the model projection FIG. 7b, 
the ventral (bottom) part of the image containing the neck has to be cropped to limit 
the AC image to the brain only. 

4. Identify the central valley on this projection. The lowermost point of the central 
10 valley defines the position of the AC line. 

5. Calculate the intensity profile along the AC line. In the ideal case, this profile 
should look like in FIG. 10b. The real profile differs from the ideal one because of 
noise, partial volume effect, not ideal positioning of the image, possible brain 
scoliosis. 

15 6. Traverse this profile. Any direction of traversing can be used, such as starting 
dorsally (from the top) and move towards the AC. Identify the second WM peak from 
the top along the AC line. Take it as the AC peak. 

7. For the identified AC peak, find its start and end points. Any method can be used 
for this purpose. In particular, the zero crossing of the second derivative can be used, 

20 see FIG. 6. 

8. As the AC landmark, take the mean value of the start and end points of the 
identified AC peak. 

9. Calculate a partial vertical (dorso-ventral) orthogonal projection of the AC image, 
ventrally from the AC horizontal line as shown in FIG. 10a. The shape of this 

25 projection is as in FIG. 10c. 
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10. Identify the highest point on this projection. It corresponds to the position of the 
vertical line passing through the inferior (I) landmark and gives the sagittal extent of 
the I landmark. 

1 1 . Traverse the I line ventrally from the AC horizontal line and identify the CSF 
5 peak. The peak has to be wide enough (for instance, few millimeters) to correspond to 

the cistern (interpeduncular fossa), and not to CSF between two gyri. The start point 
of this peak gives the axial extent of the I landmark. 

The anatomy on the PC image is shown in FIG. lla 5 and the corresponding plot 
through the PC line is drawn in FIG. lib. The further steps are following. 

10 12. Optionally, extract the brain from the PC image. Use for that any standard 
operations, such as region growing combined with morphological operations. The step 
is not mandatory, but it facilitates the subsequent steps and may improve the accuracy 
of landmark identification. The extracted brain is treated as the new PC image, and 
the subsequent operations are applied to this image. 

15 13. Calculate the histogram of the PC image and identify the intensity values for the 
cerebro-spinal fluid (CSF), grey matter (GM), white matter (WM) and background 
(B) as shown in FIG. 5. 

14. Calculate the vertical (dorso-ventral) orthogonal projection of the PC image. The 
shape of this projection is similar to that in FIG. 7b. If the calculated projection of the 

20 PC image substantially differs from the model projection FIG. 7b, the ventral 
(bottom) part of the image containing the neck has to be cropped to limit the image to 
the brain only. 

15. Identify the valleys on this projection. The lowermost point of the central valley 
defines the lateral position of the PC line. The lowermost point of the left external 

25 valley defines the sagittal extent of the right landmark (R). The lowermost point of the 
right external valley defines the sagittal extent of the left landmark (L). In case when 
the brain is extracted from the PC image, the external peaks/valleys do not exist. 
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Then, the left and right slopes of the projection define the sagittal extents of the L and 
R landmarks. 

16. Calculate the intensity profile along the PC line. In the ideal case, this profile 
should look like in FIG. lib. The real profile differs from the ideal one because of 

5 noise, partial volume effect, not ideal positioning of the image, and possible brain 
scoliosis. 

17. Traverse this profile. Any direction of traversing can be used, such as starting 
dorsally (from the top) and move towards the PC. Identify the second WM peak from 
the top along the AC line. Take it as the PC peak. 

10 18. For the identified PC peak, find its start and end points. Any method can be used 
for this purpose. In particular, the zero crossing of the second derivative can be used, 
see FIG. 6. 

19. As the PC landmark, take the mean value of the start and end points of the 
identified PC peak. 

15 20. For the given sagittal extents of the L and R landmarks (as calculated in Step 15), 
calculate their three-dimensional positions based on their definitions from FIG. 4. 

21. Calculate the horizontal (left-right image) orthogonal projection of the PC image. 

22. For the calculated horizontal projection, identify the lowermost points of the right 
extreme valley and take it as the axial extent of the superior (S) landmark. In case the 

20 brain is extracted from the PC image, the external peak/valley does not exist. Then, 
the right slope of this projection defines the superior (dorsal) extent of the brain. 

23. For the given axial extents of the S and I landmarks (as calculated in Step 11), 
calculate their three-dimensional positions based on their definitions from FIG. 4. 

24. Place at the PC that atlas axial plate, which passes through the PC (the axial atlas 
25 plate 1 mm above is taken, as the exact one is not available), and scale it linearly to fit 
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to the R-L distance. The anterior and posterior extremes of the atlas plate define the 
coronal extents of the anterior (A) and posterior (P) landmarks. 

25. For the given coronal extents of the A and P landmarks, calculate their three- 
dimensional positions based on their definitions from FIG. 4. 

5 In the ideal case, the orthogonal projections of the AC and PC landmarks in coronal 
direction are in the same point, so only one of them may be calculated and placed 
accordingly at the counterparting image. 

In order to enhance the accuracy of identification of the R, L, S, and I landmarks, the 
relevant steps can be applied outside the AC and PC image images. In particular, two- 
10 dimensional horizontal and vertical projections of the whole brain volume image can 
be calculated and the extent of the brain can be obtained from these projections. 

In addition, the analysis of the profiles corresponding to the central valley for all 
coronal images, can lead to an automatic identification of the PC image (in the above 
algorithm, the PC image is selected manually by the user). The ideal profiles outside 
1 5 the AC and PC may have at most one white matter peak corresponding to the corpus 
collusum. Therefore, by analysing the number of white matter peaks in the profiles, 
the images with the AC and PC can be identified automatically by taking the images 
that contain two white matter peaks. 

2.3.2.2. Rotated coronal images 

20 When the PC image is rotated with respect to the PC line, the rotation angle has to be 
defined and the data images have to be rotated, such that the PC line is vertical (and 
then the algorithm formulated for the non-rotated case can be directly applied). 
Similarly to axial orientation, the rotation angle can be obtained by analyzing the 
orthogonal projections of the PC image and selecting the one with the deepest central 

25 valley (for Tl -weighted images), as it contains the most CSF. The rotation angle is 
calculated automatically in the following steps. 
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1 . Calculate the orthogonal projections of the PC image by taking the projections with 
a given angle step (for instance every 5 degrees). 

2. Select the projections with bi-modal peaks (one central valley). 

3. From these projections select one with the deepest central valley, see FIG. 8. 

5 4. Generate more projections of the PC image around the projection selected in step 3 
with a finer angle step in the range of the given angle step. For instance, in the range 
of +/- 5 degrees around the projection selected in Step 3, the new image projections 
are generated with 1 degree finer angle step. 

5. Find the projection with the deepest valley. The angle corresponding to this 
1 0 projection with the vertical line gives the rotation angle. 

2.3.2.3. Imaging modality dependence 

Imaging modality dependence is the same as for axial orientation, FIG. 9. 

2.3.3. Sagittal orientation 

1 5 The anatomy for the sagittal orientation is shown in FIG. 12. 

For the manually identified midsagittal image, the T-N landmarks are calculated 
automatically as follows. 

L Optionally, extract the brain from the midsagittal image. Use for that any standard 
operations, such as region growing combined with morphological operations. This 
20 step is not mandatory, but it facilitates the subsequent steps and may improve the 
accuracy of landmark identification. The extracted brain is treated as a new 
midsagittal image, and the subsequent operations are applied to this image. 
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2. Calculate the histogram of the midsagittal image and identify the intensity values 
for the cerebro-spinal fluid (CSF), grey matter (GM), white matter (WM) and 
background (B) as shown in FIG. 5. 

3. Extract the white matter structures from the midsagittal image. Any operation can 
5 be used for that, e.g., thresholding. 

4. Identify the corpus collosum (CC) on the white matter image. Any template of the 
CC and any template matching algorithm can be used. In particular, the CC template 
can be taken from the Electronic Clinical Brain Atlas (Nowinski et al, 1997), and the 
maximization of the autocorrelation function can be used for template matching. 

10 5. Define on the midsagittal image a rectangular bounding box around the CC. Form 
the region of interest from this bounding box by extending it in ventral direction. In 
particular, take the double height of the bounding box and use it as the height of the 
region of interest. 

6. Calculate the histogram in the region of interest, and get from this histogram the 
1 5 new, enhanced values of the CSF, GM and WM. 

7. Extract the white matter structures within the region of interest. Identify the fornix 
(Fo) which is the biggest connected structure below the trunk of the CC. Any method 
can be used to identify the Fo; in particular, the structure with the biggest number of 
pixels can be taken as the Fo. 

20 The fornix is a symmetrical structure located very close to the midsagittal plane and, 
in most cases, it should be present in the midsagittal slice which is acquired with a 
certain thickness. If the fornix is not present in the midsagittal image, take a 
neighbouring image (left or right) and locate the fornix there. 

8. Find the most ventro-anterior (bottom-left most) point of the Fo, and take this point 
25 as the AC. 
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9. Draw from the AC a bottom-left quadrant with a small radius, Fig. 12. In particular, 
the radius can be of 1 cm. 

10. If in this quadrant there are several white matter regions, take the most ventro- 
anterior one, calculate its center and take it as the new AC (discard the previous AC). 

5 11. Extract the white and grey matter structures within the region of interest. Any 
operation can be used for that, e.g., thresholding. Identify the massa intermedia (MI) 
which is the only GM structure within the CC bounding box, under the CC trunk. 

12. Identify the most ventral point of the MI. 

13. Draw a semi-line from the AC passing through the most ventral point of the MI, 
10 Fig. 12. 

14. Starting from this position, rotate the semi-line clockwise around the AC, and cast 
a ray along this semi-line. 

15. Identify the first WM structure encountered by the ray in a certain distance from 
the AC. In particular, the distance ranging from 17 mm to 35 mm from the AC can be 

15 used. 

16. Calculate the center of the identified WM structure and take it as the PC. 

17. Draw a line passing through the AC and PC. The points of intersection of the 
cortex with this line define the A landmark (on the left side) and the P landmark (on 
the right side). Any direction of traversing the AC-PC line can be used. In particular, 

20 when traversing this line from outside, the first peak corresponds to the scalp and the 
following slope to the cortex (when the brain is extracted from the midsagittal image, 
the first peak does not exist and the slope corresponds to the cortex). 

18. Draw a line perpendicular to the AC-PC line and passing through the PC. The 
point of intersection of the cortex with this line defines the axial extent of the S 

25 landmark (on the topside). Any direction of traversing the vertical PC line can be 
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used. In particular, when traversing this line from outside, the first peak corresponds 
to the scalp and the following slope to the cortex (when the brain is extracted from the 
midsagittal image, the first peak does not exist and the slope corresponds to the 
cortex). 

5 19. For the given axial extents of the S landmark, calculate its three-dimensional 
position based on its definition from FIG. 4. 

20. Measure the S-PC distance between the S and PC landmarks. 

21 . Calculate the axial (ventral) extent of the I landmark proportionally with respect to 
the atlas. In particular, take the axial extent of the I landmark at the (S~PC)/74*43 

1 0 distance from the AC-PC plane. 

22. For the given axial extent of the I landmark, calculate its three-dimensional 
position based on its definition from FIG. 4. 

23. Place at the PC that atlas axial plate, which passes through the PC (the atlas axial 
plate 1 mm above the AC-PC plane is taken, as the exact one is not available), and 

15 scale it linearly to fit to the A-P distance. The lateral extremes of this atlas plate 
define the sagittal extents of the left (L) and right (R) landmarks. 

24. For the given sagittal extents of the L and R landmarks, calculate their three- 
dimensional positions based on their definitions from FIG. 4. 

In order to enhance the accuracy of identification of the A, P, S, and I landmarks in 
20 three dimensions, the relevant steps can be applied to the images lying outside the 
midsagittal image. In particular, the maximum dorsal extent of the S landmark can be 
searched as in Step 18 along the whole AC-PC line, not only for the PC point. In a 
similar way, the I landmark can be searched on the images outside the midsagittal 
image. 
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The accuracy of the landmark identification in three dimensions can be enhanced by 
calculating two-dimensional horizontal and vertical projections of the whole brain 
volume image and obtaining from these projections the extent of the brain in axial, 
coronal and sagittal directions. 

5 3. Labelling 

Labelling consists of two major steps, label assignment and label placement. Label 
assignment determines the label, or labels, for the pointed location. Label placement 
is the way of displaying the label, or labels, on the image. Labeling can be done in 
two modes, a single label mode and multi-label mode. 

10 3.1. Label assignment 

Label assignment is done in two steps. First, for a pointed data location, the 
corresponding atlas location is calculated. Second, for a given atlas location, its label 
is determined. 

When a cursor is placed over the data image, the coordinates of the image location are 
1 5 read and the coordinates of the corresponding atlas plate are calculated based on the 
inverse registration transformation. In particular, this may be the inverse Talairach 
transformation. 

For a given atlas location, its label can be determined in two ways. When a fully 
color-coded atlas is used (the atlas in image representation), a table is constructed 
20 with color-structure correspondence. The color read at the pointed location indexes 
this table and gives the name of the pointed structure. 

When the atlas is used in geometric representation, the structures are available as 
contours (sets of points). Every contour has the assigned (corresponding) structure 
and this assignment is stored in the contour-structure table. A given atlas location is 
25 checked against the existence of the smallest contour containing this location, and 
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when the contour is identified, it indexes the contour-structure table and the label is 
produced. 

3.2. Label placement 

The labeling can be done in two modes: single label mode and multi-label mode. The 
5 single label mode is dynamic, while the multi-label mode is static In single-label 
mode, the name of the structure is placed on the image next to the cursor. In 
particular, it can be placed in a circle of 5 pixel radius. The label is refreshed 
dynamically such that is follows the moving cursor. 

In multi-label mode, the user can place interactively multiple labels on the image. The 
1 0 user clicks the image, drags the mouse and draws the arrow pointing to the structure, 
releases the mouse, and the label is displayed at the end of the arrow. When the 
clicked location is not labelable (which means no label exists for it), the arrow is not 
drawn. 

The same method of producing the label on the image can be used when the user 
15 searches for a structure in the image by selecting the name of the structure in the 
anatomical index (list). 

4. Regions of interest 

The region of interest can be drawn by the user as a geometrical object related to the 
labelled structures. In general, the region of interest can be any closed polyline; in 
20 most cases, however, this region will be rectangle or ellipsis, FIG. 13. 

The regions of interest can also be annotated to provide additional diagnostic 
information. The user can first define several regions of interest and label the 
structures within them. Alternatively, he or she can label the relevant part of the 
image first and then encompass it within the region of interest. The placement of 
25 regions of interest is optional. 
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5. Mensuration 

The user is allowed to measure distances and angles on the data images. 

6. Saving 

The atlas-enhanced images prepared by the neuroradiologist can be saved for further 
5 processing by other medical professionals. The present invention proposes two ways 
of saving the atlas-enhanced images (or, in the extreme case, the atlas itself), as a 
web-enabled file and/or as DICOM file, FIG. 14. 

The atlas-enhanced images stored in a web-enabled format such as XML are suitable 
for web-enabled applications, while stored in DICOM format they can be saved in 
10 Picture Archival and Communication System (PACS) and used in Dicom compatible 
applications, such as radiological or surgical workstations for further processing by 
neurologists, neurosurgeons and other medical professionals, FIG. 14. The data and 
atlas images can be saved separately as two corresponding images or as a single 
image with a user-defined amount of blending between them. 

15 FIG. 15 illustrates a method of saving the atlas-enhanced image in Dicom format. The 
labels (texts and arrows), the regions of interest (ROIs) with annotations, and the 
mensurations are saved in three different Dicom overlays (Dicom 60xx). The atlas, 
represented as a color image, can be stored in multiple Dicom overlays (there are 16 
of them in total). In particular, if the 8-bit indexed color is used (256 colors), each 

20 atlas byte corresponding to a given location can be stored in eight Dicom overlays. 

When the atlas is in geometric representation (which means, as a set of contours) the 
contours can be saved in a single Dicom overlay. Alternatively, the contours can be 
saved in Dicom contour overlay (Dicom 50xx). 

The atlas enhanced data can be stored in any web-enabled markup language. In 
25 particular, this markup language can be XML (extensible Markup Language). The 
atlas and data images can be saved then as bitmapped image elements (which means 
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as layers which subsequently can be blended), while the labels, regions of interest, 
annotations, mensurations, and/or atlas in geometric form (set of contours) can be 
saved as vector graphics. Vector graphics data can be saved, for instance, as VML 
elements, where VML (vector markup language) is an application of XML. 
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Claims 

1. A method of analysing an image of a brain, the method comprising the steps 
of: 

5 receiving data defining a three-dimensional image of a brain; 

comparing the received data with a brain atlas to generate a three-dimensional 
mapping between the image and the brain atlas; 

using the mapping to annotate the received data; and 

writing said annotated data as one or more data files. 

10 2. A method according to claim 1 in which said data is received from a file in 
Dicom format. 

3 . A method according to claim 1 in which in said writing step the annotated data 
is written in Dicom or a web-enabled format, such as XML format. 

4. A method according to claim 1 in which said step of comparison is performed 
15 by the steps of: 

(i) identifying a set of first features in said image corresponding to respective 
second features in said brain atlas; 

(ii) defining a first direction in said image, and a plurality of first planes in the 
image perpendicular to and spaced apart in said first direction, each first plane 

20 containing one or more of said first features, and corresponding to a respective second 
plane in the brain atlas containing the corresponding one or more second features; 

(iii) partitioning each first plane into rectangular sections based on said first 
features; 
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(iv) for each first plane, applying a linear transformation to each section to 
transform its dimensions to be equal to those of a respective rectangular section of the 
corresponding second plane; and 

(v) defining a transformation of the spacing between said first plane which makes 
5 the spacing of the first planes equal to the spacing of the corresponding second planes. 

5. A method according to claim 1 in which said step of comparison is performed 
by the steps of: 

(i) identifying a set of first features in said brain atlas corresponding to respective 
second features in said image; 

1 0 (ii) defining a first direction in said brain atlas, and a plurality of first planes in the 
brain atlas perpendicular to and spaced apart in said first direction, each first plane 
containing one or more of said first features, and corresponding to a respective second 
plane in the image containing the corresponding one or more second features; 

(iii) partitioning each first plane into rectangular sections based on said first 
1 5 features; 

(iv) for each first plane, applying a linear transformation to each section to 
transform its dimensions to be equal to those of a respective rectangular section of the 
corresponding second plane; and 

(v) defining a transformation of the spacing between said first plane which makes 
20 the spacing of the first planes equal to the spacing of the corresponding second planes. 

6. A method according to any preceding claim in which said step of annotation is 
performed by selecting regions of interest on the image, and deriving from the brain 
atlas information associated with this region of interest. 

7 A method according to any preceding claim in which said step of annotation 
25 includes placing text on the brain image. 
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8 A method according to any preceding claim in which said step of annotation 
includes placing mensuration on the brain image. 

9. A method according to any preceding claim in which said step of annotation 
includes labelling of one or more regions of interest based on labels associated with 

5 corresponding portions of the brain atlas. 

10. A method according to claim 9 in which a user selects said regions of interest 
successively, and the labels at any instant correspond to the corresponding selection. 

11. A method according to any preceding claim in which a user points or clicks 
any structure in the image successively, and, at the pointed location the label of the 

10 said structure is being generated, while when clicking and dragging the mouse the line 
is drawn and the label of the said structure is placed at the end of the said line. 

12. A method according to any of claims 7 to 1 1 comprising a step of generating a 
lookup table defining a mapping between the portions of the image and respective 
anatomical indices, said labels being generated using the table. 

15 13. A method according to claim 12 in which the user can make each of said 
selections using either said image or by selecting one of said indices. 

14. A method according to any preceding claim in which said step of comparison 
is based on a plurality of landmarks in the image. 

15. A method of mapping an image of a brain to an existing brain atlas, the 
20 method comprising the steps of: 

(i) identifying a set of first features in said image corresponding to respective 
second features in said brain atlas; 

(ii) defining a first direction in said image, and a plurality of first planes in the 
image perpendicular to and spaced apart in said first direction, each first plane 
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containing one or more of said first features, and corresponding to a respective second 
plane in the brain atlas containing the corresponding one or more second features; 

(iii) partitioning each first plane into rectangular sections based on said first 
features; 

5 (iv) for each first plane, applying a linear transformation to each section to 
transform its dimensions to be equal to those of a corresponding rectangular section of 
the corresponding second plane; and 

(v) defining a transformation of the spacing between said first plane which makes 
the spacing of the first planes equal to the spacing of the corresponding second planes. 

10 16. A method of mapping an existing brain atlas to an image of the brain, the 
method comprising the steps of: 

(i) identifying a set of first features in said brain atlas corresponding to respective 
second features in said image; 

(ii) defining a first direction in said brain atlas, and a plurality of first planes in the 
1 5 brain atlas perpendicular to and spaced apart in said first direction, each first plane 

containing one or more of said first features, and corresponding to a respective second 
plane in the image containing the corresponding one or more second features; 

(iii) partitioning each first plane into rectangular sections based on said first 
features; 

20 (iv) for each first plane, applying a linear transformation to each section to 
transform its dimensions to be equal to those of a corresponding rectangular section of 
the corresponding second plane; and 

(v) defining a transformation of the spacing between said first plane which makes 
the spacing of the first planes equal to the spacing of the corresponding second planes. 
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17. A method according to claims 15 or 16 in which said features of the image are 
a plurality of landmarks. 

18. A method of forming a mapping between a brain image and a brain atlas, the 
method including: 

5 defining a plurality of landmarks in the image, said landmarks being 

calculated using peaks and valleys of a graph of the density profile of the image 
measured along a line and/or peaks and valleys of a projection along a specified 
direction; 

forming said mapping based on the correspondence of the positions of said 
1 0 landmarks in the brain image with corresponding landmarks in the brain atlas. 

19. A method according to claim 18 in which the line is the AC-PC line. 

20. A method according to claim 19 further including a step of identifying the 
position of the AC-PC line from an antero-posterior projection of the image. 

21. A method according to claim 20 in which the position of the AC-PC line is 
15 defined using the location of the central valley of the antero-posterior projection of 

the image. 

22. A method according to claim 18 in which the line is the AC line or the PC 
line. 

23. A method according to any of claims 18 to 22 in which the orientation of the 
20 image is determined by obtaining a projection of the image at each of a plurality of 

angles, and orientation (the rotation angle) is derived from the projection for which 
the central depression is deepest. 

24. A method according to claim 23 in which the orientation determined is the 
axial orientation, the plurality of projections of the image are at each a plurality of 
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angles, and the rotation angle is derived form the projection for which the central 
depression is deepest. 

25. A method according to claim 23 in which the orientation determined is the 
coronal orientation, and the plurality of projections of the image are at each of a 

5 plurality of angles. 

26. A method according to any of claims 14 or 17 to 25 in which the landmarks 
include the left L and/or right R landmarks on the axial image, which are calculated 
based on the locations of the right external valley and the left external valley in the 
vertical (antero-posterior) projection of the image. 

10 27. A method according to any of claims 14 or 17 to 26 in which the landmarks 
include the anterior A and/or posterior P landmarks on the axial image which are 
calculated based on the locations of the right external valley and the left external 
valley in the horizontal (left-right) projection of the image. 

28. A method according to any of claims 14 or 17 to 27 in which the landmarks 
1 5 include the right R and/or left L landmarks on the coronal image which are calculated 

based on the locations of the left external valley and the right external valley in the 
vertical (dorso-ventral) projection of the image. 

29. A method according to any of claims 14 or 17 to 28 in which the landmarks 
include the superior S landmark on the coronal image which is calculated based on the 

20 location of the right external valley in the horizonatal (left-right) projection of the 
image. 

30. A method according to any of claims 14 or 17 to 29 in which the landmarks 
include inferior I landmark on the coronal image which is calculated based on the 
location of the highest peak in the partial vertical (dorso-ventral) projection of the AC 

25 image taken ventrally from the AC horizontal line. 
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31. A method as claimed in any one of claims 18 to 30 in which each reference to a 
"peak" is replaced by a reference to a "valley", and each reference to a valley is 
replaced by a reference to a peak. 

32. A method according to any of claims 14 or 17 to 31 in which the landmarks 
5 include the superior S and inferior I landmarks on the axial image which are 

calculated based on the scaling of the brain atlas. 

33. A method according to any of claims 14 or 17 to 32 in which the landmarks 
include the anterior A and posterior P landmarks on the coronal image which are 
calculated based on the scaling of the brain atlas. 

10 34. A method according to any of claims 14 or 17 to 33 in which the landmarks 
include the AC landmark on the midsagittal image which is calculated based on the 
analysis of the bounding box around the corpus collosum and identifying below it in 
the constraint region the most ventro-anterior white matter structure. 

35. A method according to any of claims 14 or 17 to 34 in which the landmarks 
1 5 include the PC landmark on the midsagittal image which is calculated by drawing a 

semi-line from the AC to the bottom of the massa intermedia, and rotating this line 
clockwise unit the first white matter structure is encountered. 

36. A method according any of claims 14 or 17 to 35 in which the landmarks 
include the anterior A and posterior P landmarks on the midsagittal image which are 

20 calculated by drawing a line passing through the AC and PC landmarks and 
identifying the extent of the cortex. 

37. A method according to any of claims 14 or 17 to 36 in which the landmarks 
include the superior S landmark on the midsagittal image is calculated by drawing a 
line perpendicular to the AC-PC line and passing through the PC and identifying the 

25 intersection of this line with the cortex. 
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38. A method according to any of claims 14 or 17 to 37 in which the landmarks 
include the inferior I landmark on the sagittal image which is calculated by scaling the 
brain atlas. 

39. A method according to any of claims 14 or 17 to 38 in which the landmarks 
5 include the left L and R landmarks in the sagittal three-dimensional brain image 

which are calculated by scaling the brain atlas. 

40. A method as claimed in any preceding claim in which an image of the brain is 
any medical imaging modality image. 

41. A computing apparatus arranged to perform a method according to any 
1 0 preceding claim. 

42. A computer program product comprising computer program instructions 
readable by a computer apparatus to cause the computer apparatus to perform a 
method according to any of claims 1 to 40. 
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